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Description 

[System and Method for Managing 
Transcripts and Exhibits] 

Background of Invention 

[000 1 ] RELATED APPLICATIONS: This application incorporates by 
reference U.S. patent Application No. filed July2001, enti- 
tled "Transcript Management Software and Method There- 
for" U.S. patent Application No.filed March2002, entitled 
"Methods for Synchronizing On-Line and Off-Line Tran- 
script Projects; U.S. provisional patent application serial 
number 60/494,061, filed August 7, 2003, titled "Com- 
puter Program Product Containing Electronic Transcript 
and Exhibit Files and Method for Making the Same, "and 
incorporated herein by reference as if set out in full; and 
United States Patent Application No. 10/710,796, titled 
"Computer Program Product Containing Electronic Tran- 
script and Exhibit Files and Method for Making the 
Same, "filed August 3, 2004, and incorporated herein as if 
set out in full. The present application claims priority to 



pending provisional application serial number 
60/493,994, filed August 8, 2003, titled System and 
Method for Managing Transcripts and Exhibits, which ap- 
plication is incorporated herein by reference as if set out 
in full. 

[0002] BACKGROUND: Presently, many people receive electronic 
copies of court proceedings, such as, for example, depo- 
sitions, court transcripts, testimony, or the like, electroni- 
cally (generically referred to as "electronic transcripts"). 
The electronic transcript provides a good tool to navigate 
and full text search the transcript and has proven useful 
for a number of reasons. 

[0003] Conventionally, however, court proceedings, such as, for 
example, depositions include the use of written materials, 
such as exhibits. In this case, the exhibits are often only 
available with the written transcript. Sometimes, the ex- 
hibits are converted into electronic format, such as by 
scanning, and appended to the electronic transcript. Un- 
fortunately, while accessible electronically, the association 
and use of the electronic exhibit is not very convenient, 
fixed, bulky, and frequently difficult to coordinate. 

[0004] Thus, it would be desirous to develop systems and 
method for managing transcripts and exhibits. 



[Field of the Invention] 

[0005] The present invention relates to electronic transcripts and 
associated electronic exhibits and, more particularly, sys- 
tems and method to manage electronic transcripts and 

associated exhibits that are converted into digital form. 
Summary of Invention 

[0006] The present invention relates to systems and method for 
managing transcripts and exhibits electronically. In par- 
ticular, the present invention provides systems and meth- 
ods for managing electronic transcripts and exhibits. In 
particular, the methods provide for selection and elec- 
tronic transcript to be associated with an electronic ex- 
hibit. As association tool is displayed and the user-de- 
fined association is provided. The user-defined associa- 
tion is identified with at least one exhibit, and the associ- 
ation is applied to the transcript such that the associated 
exhibit can be displayed as desired by the user. 

[0007] The foregoing and other features, utilities and advantages 

of the invention will be apparent from the following more 

particular description of a preferred embodiment of the 

invention as illustrated in the accompanying drawings. 
Brief Description of Drawings 



[0008] The accompanying drawings illustrate various embodi- 
ments of the present invention and are a part of the spec- 
ification. The illustrated embodiments are merely exam- 
ples and illustrations of the present invention and do not 
limit the scope of the invention. 

[0009] FIG. 1 illustrates a functional block diagram of an operat- 
ing environment in which the present invention may func- 
tion; 

[0010] FIG. 2 illustrates a functional block diagram of a transcript 
management system consistent with an embodiment of 
the present invention; 

[0011] FIG. 3 is a flowchart illustrating one operation consistent 
with an embodiment of the present invention; 

[0012] FIG. 4 is a flowchart illustrating another operation consis- 
tent with an embodiment of the present invention; 

[0013] FIG. 5 is one possible graphical user interface consistent 
with an embodiment of the present invention; 

[0014] FIG. 6 is a flowchart illustrating yet another operation 

consistent with an embodiment of the present invention; 
and 

[0015] FIG. 7 is one possible graphical user interface consistent 
with an embodiment of the present invention useful for 
the operation of FIG. 6. 



Detailed Description 

[0016] with reference to FIGS. 1-7, an embodiment of the 

present invention will be described. The present invention 
relates to systems and methods for improving the associ- 
ation between electronic transcripts and electronic ex- 
hibits, particularly in transcripts and exhibits relating to 
court or legal proceedings. The present invention is de- 
scribed as operating on a personal computer, but one of 
ordinary skill in the art would appreciate that the inven- 
tion could be implemented on other systems, such as, 
hand-held devices, multiprocessor systems, local area 
networks (LANs), wide area networks (WANS), wireless 
networks (WLANs), optical networks, Ethernet, Internet, 
World Wide Web, microprocessor based or programmable 
consumer electronics, mainframe systems, multiple server 
systems, or the like. Upon reading the disclosure, one of 
ordinary skill in the art will now recognize that alternate 
and equivalent embodiments of the present invention are 
possible and may be made without departing from the 
spirit and scope of the present invention. 

[0017] with reference to FIG. 1, a conventional personal com- 
puter 100 capable of implementing the present invention 
will be described. Generally, personal computer 100 in- 



eludes a processing unit 102, a system memory 104, and 
a system bus 106. System bus 106 couples the various 
system components and allows data to be exchanged be- 
tween the components. System bus 106 could operate on 
any number of conventional bus protocols. System mem- 
ory 104 generally comprises both a random access mem- 
ory (RAM) 108 and a read only memory (ROM) 110. Other 
types of memory, such as DRAM, SDRAM, or the like could 
be included as well. 

[0018] ROM 110 generally stores basic operating information 

systems such as a basic input/output system (BIOS) 112. 
RAM 108 often contains the basic operating system (OS) 
114, application software 116 and 118, and data 120. 

[0019] personal computer 100 generally includes one or more of 
a hard drive 122, a magnetic disk drive 124, or an optical 
disk drive 126. The drives are connected to the bus 106 
via a hard disk drive interface, a magnetic disk drive inter- 
face 130, and an optical disk drive interface 132. Applica- 
tion modules and data may be stored on a disk, such as, 
for example, hark disk installed in the hard disk drive (not 
shown). 

[0020] Personal computer 100 also may have network connection 
134 to a network, such as, for example, a LAN, WAN, 



WLAN, WiFi, Optical, Ethernet, Internet, or the World Wide 
Web, and/or a serial port 136, USB or the like to connect 
to peripherals, such as a mouse, keyboard, modem, 
speakers (internal or external) or a printer. Personal com- 
puter may also have USB ports or wireless components as 
are generally known in the art. 

[0021] Personal computer 100 typically has a display or monitor 
138 connected to bus 106 through an appropriate inter- 
face, such as a video adapter 140. On reading this disclo- 
sure, those of ordinary skill in the art will recognize that 
many of the components discussed as separate units may 
be combined into one unit and individual units may be 
split into several different units. Further, the various func- 
tions and components could be located in a single device, 
or spread over several local and/or remote devices using, 
for example, a network. 

[0022] |f personal computer 100 is connected to a network, typi- 
cally one or more remote network servers exist to manage 
the network resources. The network server may be an- 
other personal computer (or personal computer 100 could 
act as the server), a server, or other equivalent device. 

[0023] | n the description that follows, the present invention may 
be described with reference to parts of personal computer 



100. However, it should be understood that such refer- 
ences are exemplary and not to limit the present invention 
to the above-described operating environment as those 
skilled in the art will appreciate that various operating en- 
vironments may implement the present invention. 
[0024] Embodiments of the present invention provide various 
features for use with a transcript management system, 
which may be embodied in software (as used herein, the 
terms software, systems, modules, computer code de- 
vices, computer programs are used interchangeably) op- 
erating on a processor, such as personal computer 100 
above. Transcript management systems in accordance 
with embodiments of the present invention provide a user 
with the ability to manage various electronic transcripts 
and exhibits and arrange them, for instance as projects or 
files. Transcript management systems are provided with 
exhibit handling capabilities so that scanned digital im- 
ages of exhibits, imported files, streamed files or the like 
can be input and managed within the electronic transcript 
management software. Accordingly, a user of the tran- 
script management software may browse, organize, and/ 
or review both electronic transcripts and exhibits for par- 
ticular projects or court cases. Various embodiments of 



the invention will now be described. 

[0025] Fig. illustrates a function block diagram of transcript man- 
agement system 200 operating on personal computer 
100. In Fig. the transcript management system 200 re- 
ceives electronic transcript files 202 and exhibit files 204. 
In one example, the files may be obtained from bundles or 
collections of selected transcripts and exhibits that are 
stored in a file, written to a medium 214, such as a hard 
disk, magnetic disk, or optical disk, or the like. Medium 
214 would be inserted into an appropriate drive 216. 

[0026] when stored in a file (or files), the file may be stored in a 
memory. The memory may be, for example, a local mem- 
ory 208 that stores projects consisting of electronic tran- 
script files 208a and electronic exhibit files 208b. Exhibit 
file 208b may be a video file, an audio file, an audio/video 
file, a still image, a textual document, or imported from a 
scanner as a TIF, PDF, JPG, bitmap, GIF format file. Instead 
of being located locally, the memory may be remote 
memory 210 that is accessible though a network 212. 
When accessible through a network 212, other transcript 
management systems 200. may have access to the files. 
Thus, conventional security protocols should be imple- 
mented. 



[0027] Transcript management system 200 also provides a user 
interface 202. User interface 202 accepts user input 218 
from any conventional source, such as, for example, a 
keyboard, a mouse, a pointer, a light pen, a touch-screen, 
etc. User interface 202 provides displays for the electronic 
transcript files, electronic exhibit files, control interfaces, 
and the like. For example, user interface may provide a 
media player 220 provides the ability to play audio, video, 
audio video and the like. A first viewer 222 provides the 
ability to display electronic transcript files. A second 
viewer 224 provides the ability to display electronic ex- 
hibit files. Media player 220 and viewers 222 and 224 are 
configured for whatever formats the media and/or files 
are stored. For example, the media player 220 may be 
configured to display MPEG files, the first viewer may be 
configured to display electronic transcript files, the sec- 
ond viewer may be configured to display pdf or jpeg files. 
The number of viewers should coincide with the number 
of viewers necessary to display the transcripts, exhibits, 
and the like. 

[0028] when the projects are saved to a medium 214, such as, 
for example, a magnetic disk or an optical disk, the files 
and viewers may be stored on the medium 214 and 



launched when installed or on an as needed basis. Also, 
files 208a and 208b may be bundled into bundles 226. 
Bundles 226 may include executable code to launch, load, 
or install viewers as necessary. 

[0029] user interface 202 may receive user input through a con- 
ventional input devices associated with BIOS 112. Such 
controls may include keyboard, mouse, pointer, touch 
pads, light pen, or other input devices. It is envisioned, 
however, that organizational controls 228 would mostly 
be point and click style controls, but any of the aforemen- 
tioned or other devices are possible. Other controls 230 
include dialog boxes, popup menus, pull down menus, 
and the like. While separated for convenience, organiza- 
tional controls 228 and other controls 230 could be de- 
scribed as a single entity or many entities as desired. 

[0030] viewers 222 and 224 are provided as separate because 
transcript viewers or windows are preferably separately 
displayable and controllable from exhibit viewers or win- 
dows. Similarly, if an audio, video of a legal deposition 
was taken, transcript management system 200 could syn- 
chronize the audio, video with the electronic transcript 
such that the following may occur. Referring specifically to 
FIG. 3, an electronic transcript could be selected, step 



302, and displayed in a first window, step 304. Next, a 
synchronized audio, video of the transcript is initiated, 
step 306, and played in a second window, step 308. The 
transcript in the first window would indicate the text as it 
is spoken in the video/audio and advance along with the 
audio/video, step 310. Optionally, any associated exhibits 
may be selected, step 312, and displayed in a third win- 
dow, step 314. Notice, the selecting and displaying of the 
exhibits in the third window could be accomplished auto- 
matically. 

[0031] Referring now to FIG. 4, a flowchart 400 is provided illus- 
trating an operation of the transcript management system 
200. The operation described in flowchart 400 is ex- 
plained in conjunction with interface 500 shown in FIG. 5. 
First, transcript management system 200 initiates and 
displays user interface 500, step 402. User interface 500 
is split into three distinct panels (although that is a matter 
of design choice). Panel 502 is a project or bundle panel. 
Panel 504 is a transcript panel. Panel 506 is an exhibit 
panel, exhibits are generically referred to as documents. 
Panel 502 contains a tool bar 508 that provides controls 
to allow a user to organize various bundles or projects. 
For example, tool bar 508 may have a new bundle tool 



510 or other tools, such as, for example, a remove tool, a 
duplicate tool, or the like. Tool bar 508 may have controls 
to add information to transcript panel 504 and exhibit 
panel 506. 

[0032] Bundle panel 502 currently includes a single project or 
bundle 512, titled United States of America v. Timothy 
James McVeigh. By highlighting bundle 512, transcript 
panel 504 and exhibit panel 506 are populated with tran- 
script files and exhibit files already associated with the 
bundle 512. Additional transcripts and exhibits may be 
imported. 

[0033] Referring back to FIG. 4, we will assume the transcript 
management system 200 has already been populated in 
part, as shown in FIG. 5. To add a new transcript to bun- 
dle 512, the user imports a new transcript from electronic 
transcript files 208a, for example, step 404. Importation 
of the transcript can be accomplished using tool bar 508 
by clicking on the transcript pull down menu, which allows 
the user to select or browse for electronic transcript files 
and select a transcript to be imported. Alternatively, the 
user could access transcript tool bar 514 and select the 
add function. To add a new exhibit to bundle 512, the 
user imports a new exhibit from electronic exhibit files 



208b, for example, step 406. Again the user can accom- 
plish this by using tool bar 508 or exhibit tool bar 516. 
[0034] As mentioned above, the transcript may have a media file 
associated with it, such as, for example, a video taped de- 
position. In this case, the media file can be synchronized 
and appended to the electronic transcript in a conven- 
tional manner, step 408. A synchronized and appended 
media file would be indicated in a media field 518. The 
media could be launched with the display of the transcript 
or separate. 

[0035] Similarly, exhibit files could have character recognition 
performed to allow text searching of the exhibits. The 
character recognition would be done in conventional 
manners and appended to the exhibit, step 410. If the ex- 
hibit file has character recognition, it would be indicated 
in OCR field 520. 

[0036] while transcript panel is shown as having a specific anno- 
tation relating to media and exhibit panel is shown as 
having a specific annotation relating to character recogni- 
tion, other types of annotations are possible. For example, 
notes and information taken by an attorney during a de- 
position may be annotated to the electronic information, 
bates numbers may be added, authentication information, 



or the like may be added. 

[0037] Once the bundle is populated, as for example, in FIG. 5, 
associations between the electronic transcripts 522 and 
524 are provided, step 412. Transcripts 522 may have no 
exhibits, one exhibit, or many exhibits associated. Ex- 
hibits 524 may also be associated with no transcripts, one 
transcript, or many transcripts. However, it would be un- 
usual to populate exhibit panel 506 with an exhibit that 
was not associated with a transcript 522. 

[0038] Referring to FIG. 6, a flowchart 600 is provided illustrating 
one embodiment of establishing the association between 
the transcript files 522 and exhibit files 524. Flowchart 
demonstrates associating the transcript to the exhibits, 
but the alternative is also possible. Further, FIG. 6 de- 
scribes using a hyperlink, but any conventional associa- 
tion between the files is possible. Flowchart 600 will be 
explained with reference to panel 500 and to display 700 
in FIG. 7. 

[0039] jo establish associations, or links, a transcript is selected, 
step 602. In this case, transcript 526 is selected (FIG. 5). 
The user next selects the link tool 528 on transcript tool 
bar 514, step 604. A link display 700 is then displayed to 
the user, step 606. Link display 700 is exemplary. Link 



display 700 may have a title bar 702 for information and/ 
or navigation. Link display 700 provides a dialog box 704 
that includes a find what box 706, a link box 708, and an 
action box 710. Find what box 706 is a full text search 
tool that allows the user to search the selected transcript 
for whatever text, symbol, or the like the user desires. The 
link box provides what the text in the find box should be 
linked to, and the action box provides the action to be ac- 
complished. For example, once the link display is dis- 
played, the user would enter the desired textual link 
phrase, step 608. Textual is used generically, and could 
be any of a graphical or alphanumerical link. In this case, 
the user selected the phrase "piece." Next, the user would 
select what exhibit the phrase "piece"should be associated 
with, step 610. In this case, the user selected that "piece" 
should be associated with exhibit 830. Alternatively, the 
user can navigate the transcript text pane and select the 
specific text or area to be associated. Finally, in the action 
box, the user selects the action the transcript manage- 
ment system 200 should take, step 612. In this case, the 
system 200 should mark the text "piece"to indicate a link 
to exhibit 830. Whether a particular text reference to 
"piece" should be linked to exhibit 830 is determined by 



the user by indicating a link should be placed, step 614, 
in other words, should the indicated action be applied. 
This action is initiated by activity button 712. Alternatively 
to a phrase-by-phrase linking, a user could select the link 
all activity button 714 to link all occurrences of "piece" to 
exhibit 830. Finally, piece could be linked to multiple ex- 
hibits by providing multiple links. While the above has 
been described with reference to a particular word, the 
association tool provides full user designation. In other 
words, the user could link based on page numbers, line 
numbers, page and line numbers, exhibit numbers, bates 
numbers or ranges, or the like. Alternatively, when the 
transcript management software imports files, such as 
XML files, that contain electronic transcript files and ex- 
hibit image files, the transcript management software 
may, in one example, automatically create hyperlinks be- 
tween the exhibit's introduction points and the respective 
transcripts. The transcript management system may 
search or parse the transcript text for identifiers such as 
the word "EXHIBIT" or "EX"or "EXH-"or other identifiers of 
exhibits. Once the transcript management software lo- 
cates an occurrence of such identifier, the transcript man- 
agement software may examine the field or text immedi- 



ately following the identifier in order to extract the exhibit 
number from the transcript text. Having located the first 
occurrence or mention of a particular exhibit number 
within the transcript text, the transcript management 
software may then create an automatic link between this 
text and the exhibit image file. In one example, each ex- 
hibit image file is assigned an exhibit number by the user, 
preferably the same exhibit number as used within the 
transcript text. Hence, the transcript management soft- 
ware can automatically link or associate the first occur- 
rence, or each occurrence, all occurrences or selected oc- 
currences of a particular exhibit number referenced in the 
electronic transcript text with a particular exhibit image. 

[0040] The example of various operations of system 200 may in- 
clude one or more of the operations shown above in the 
same or different order, and one or more of the opera- 
tions may be combined or subdivided. 

[0041] | n one example, the bundles may be downloaded to mem- 
ory from transcript management system 200 which might 
be represented as a web application or service. Once 
downloaded, the bundles may be uploaded into transcript 
management system 200 form operations, such as, 
adding or removing a transcript, adding or removing an 



exhibit, establishing additional or removing pervious as- 
sociations, and the like. Ideally, downloading and upload- 
ing does not influence previous annotations, notes, asso- 
ciations, or the like. Preferably, when a bundle is im- 
ported, only transcripts and exhibits within the bundle 
that have not been already imported into the transcript 
management system will be uploaded. Further, annota- 
tions, notes, or other information would be synchronized 
with other versions of the bundle. 
[0042] | n another example, the transcript management system 

updates a project with the information stored in a bundle. 
For instance, assume the project is stored on an external, 
removable media such as a CDROM that contains elec- 
tronic transcripts and/or exhibit files associated with the 
project. When the user loads the media, the transcript 
management system will update any related projects with 
the information stored on the CDROM, such as associa- 
tions between particular exhibit files and electronic tran- 
scripts. If the transcript management system already con- 
tains transcripts, exhibits, OCR, annotations, links, or the 
like are also found in the bundle they are preferably de- 
tected and updated if necessary. For example, in one in- 
stance a draft transcript in the system could be updated 



with the final transcript in the bundle, preferably resulting 
in a single transcript in the system instead of two. 
[0043] | n another embodiment, the transcript management soft- 
ware may be provided with project synchronization, 
wherein if a user is utilizing a project (including electronic 
transcripts and exhibit images) in an off-line manner, 
then when the user reconnects the computing device to 
the network, the transcript management software deter- 
mines whether any changes or updates have occurred to 
the electronic transcript or exhibit files and if so properly 
synchronizes the project. For example, if a user is using a 
project or bundle having an electronic transcript that is 
not the latest electronic transcript, the transcript manage- 
ment system will synchronize the user"s project or bundle 
by associating the latest electronic transcript with the 
user"s project or bundle. Further, the transcript manage- 
ment software also associates any annotations or any ref- 
erences or hyperlinks to exhibits that the user had previ- 
ously associated with the prior version of the electronic 
transcript. 

[0044] | n another example, transcript management system 200 
may provide reports generated based on issue codes or 
search queries created by the user through fields, con- 



trols, menus, and/or dialog boxes. In one example, the 
reports contain a list of portions of a transcript that sat- 
isfy the particular query or have been marked by a user as 
corresponding to one or more particular issue codes. The 
results of the report may be viewed in a browser window 
via an internet connection or other conventional report 
generation technology, and in one embodiment, the re- 
sults may be saved as an XML file with an XSL specifier 
which describes how the XML file/data should be trans- 
formed into HTML so that the results of the report can be 
viewed in a browser window. In another example, the 
transcript management software may provide for a user to 
e-mail the reports to other users as an XML file or an 
HTML file as desired. 

[0045] while the methods disclosed herein have been described 
and shown with reference to particular steps and/or oper- 
ating environments, it should be understood that these 
steps may be combined, sub-divided, or reto form an 
equivalent method without departing from the teachings 
of the present invention. Accordingly, unless specifically 
indicated herein, the order and grouping of the steps is 
not a limitation of the present invention. 

[0046] while the invention has been particularly shown and de- 



scribed with reference to various embodiments thereof, it 
will be understood by those skilled in the art that various 
other changes in the form and details may be made with- 
out departing from the spirit and scope of the invention. 



